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Response to Amendment 

1 . In response to the office Action filed August 28, 2007, applicant has submitted an 
RCE, filed November 21, 2007 amending claims 1, 6, 11, 12, 16, 20, and 21. Applicant 
has also canceled claim 5. 

Allowable Subject Matter 

2. Claims 1-4, 6-21 are allowed. 

3. The following is an examiner's statement of reasons for allowance: 

As to claims 1,6, 11, 16, 20, and 21, there is no prior art reference, alone or in 
combination, that teaches or fairly suggests generating semantic directives from user 
supplied inpout text, the user input, and the at least one speech command to update a 
recognition vocabulary for recognizing one or more non-unified components of the 
graphical user interface; parsing the grammar between the graphical user interface and 
the speech user interface in accordance with the semantic directives to unify the 
graphical user interface with the grammar from the recognition vocabulary, then visually 
presenting the corresponding speech command and building the speech command as a 
single instance of a plurality of speech commands associated with the semantic 
directives generated. Galanes et al. (US PGPUB 2003/0200080) teaches using 



Application/Control Number: Page 3 

' 10/678,551 
Art Unit: 2626 

controls objects in order to add speech recognition to a web server in order for a user to 
navigate through the internet with voice (paragraph [0010]). Firma (US PGPUB 
2002/0010582) also teaches Taking a voice utterance and converting it to commands in 
order to operate a system of a computer via speech. However, none teach or suggest 
unifying a speech interface and GUI by allowing the user to input text and speech while 
navigating the system then taking the text grammar connecting it to the speech 
recognized by the speech interface and combining it with the input activity of the user in 
order to form an action command for the combination of one or multiple components of 
the speech interface and GUI. 

Claims 2-4, 7-10, 12-15, and 17-19 are allowed because they further limit their 
parent claims, which are allowed. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 



Any inquiry concerning this communication should be directed to Josiah 
Hernandez whose telephone number is 571-270-1646. The examiner can 
normally be reached from 7:30 pm to 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, David Hudspeth can be reached on (571) 272-7843. The 
fax phone number for the organization where this application or proceeding is 
assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). 




